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ABSTRACT 

One rationale for implementing a particular 
evaluation approach is the empowerment of stakeholders. Evaluation as 
empowerment and possible links between empowerment and increased 
utilization of evaluation results are explored. Evaluation as 
empowerment assumes that individuals need to be personally productive 
and responsible in coping with their environment. If evaluation is 
seen as empowerment, the evaluator is recognized as the enabler. A 
case study of a participatory evaluation illustrates these concepts. 
In the case study, six young people conducted a survey of youth 
employment needs in a small upstate New York community. Evaluation 
use will only become more evident if participation involves 
stakeholders in empowering ways. Stakeholders must fully understand 
the evaluation process, be willing to support it, and feel enough 
sense of involvement and accountability to work toward changes. 
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1^- Increased utilization of evaluation results has been the 

OO primary rationale for the development ot participatory or 
-J- 

stakeholder approaches. The assumption is that participation by 

rsJ 

(~~\ various constituents in the evaluation process will increas* their 
UJ 

understanding of and commitment to the use of evaluatirn results 
(Bryk, lytfj; bold, iy« 1 ; buba & Lincoln, iy«l; Hatton, ly/bj Weiss, 
1983). Another rationale for implementing a participatory 
evaluation approach is empowerment, particularly of relatively 
powerless stakeholders (Mark & Shotland, 1985). This paper will 
explore evaluation as empowerment a.,d the possible linkages between 
empowerment and increased utilization of evaluation results. 

I he ore t ical background 
Evaluation has been conceptualized in a variety of ways by 
theorists in the field. Lronbach uybU> envisions evaluation as 
explanation, Scriven (1976) sees it in terms of social utility, 
House (iybU> regards evaluation es judgement, and stake tiytft) 
suggests that evaluation is a process of understanding. In a more 
recent formulation, buba ?nJ Lincoln <\yU5) discuss evaluation as 
negot i at ion . Here . I am proposing a conceptual i zat i on of eval uat i on 



ERLC ' * T rnPY AVAILABLE 



Abstract 



increased utilization of evaluation resul.ts has been the 
primary rationale for the development of participatory or 
stakeholder approaches. The assumption is that participation by 
various constituents in the evaluation process will increase their 
understanding of and commitment to the use of evaluation results. 
Another rationale for implementing a participatory evaluation 
approach is empowerment. This paper explores evaluation as 
empowerment and the possible linkages between empowerment and 
increased utilization of evaluation results. 

Evaluation has been conceptualized as explanation (Cronbach, 
1980), social utility (Scriven, 1*76), judgement (House, 1980), as a 
proctss of understanding (Stake, 1983) and negotiation (Guba & 
Lincoln, 1985). Evaluation as empowerment assumes that underlying 
issues of power are a central question in conceptualizing what both 
the task of evaluation and the process are all about. The key 
question, then, is not whether evaluation is related to empowerment, 
but whose interests does the evaluation serve? 

Viewing evaluation as empowerment has clear implications for 
the role of evaluator. While Cronbach (1980) sees the evaluator as 
public scientist, Eisner (1983) suggests the role of 
con no i sseur/cr 1 1 1 c and Stake (1984) describes the evaluator as 
educator, the role of the evaluator in an empowerment formulation 
becomes that of enabler. Here, attention is focused primarily on 
the evaluation process (rather than the product), assisting 
stakeholders to participate and shar* power effectively. 

Finally, possible linkages between empowerment and the 
increased use of evaluation results are examined, with stakeholder 
empowerment seen as a mediating variable between participation and 
ut i 1 izat ion • 

The conceptualization for this paper is based on a case study 
of a participatory evaluation in which empowerment of the 
stakeholders was a primary objective. Specific examples from the 
study are used to ill citrate the theoretical principles discussed. 
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as empowerment. This conceptualization openly recognizes the issue 
o+ power m evaluation and focuses attention primarily on the 
evaluation process. The emphasis is on assisting stakeholders to 
participate in important ways and share power effectively. 

Each view of evaluation involves certain assumptions about the 
purposes of evaluation and its implications. Evaluation as 
empowerment assumes that under 1 y mg issues of power are a central 
question in conceptualizing what both the tasK of evaluation and the 
process are all about. Knowledge is assumed to be a source o-f power 
and since an evaluation produces Knowledge, whoever possesses or 
controls that information has power. Tne Key question, then, is not 
whether evaluation ;s related to empowerment, but whose interests 
doe* the evaluation serve? 

because of the range of thinKers discussing empowerment, the 
concept has yet to be clearly defined (Cochran, 1986). There are, 
however, some underlying assumptions common to all. une such 
assumption is that individuals can understand their own needs better 
than anyone else (par 1 1 cu I ar I y the experts) and consequently they 
should have the power both to define and act upon them (Cochran, 
ly«6; hernandes & landon, lyai; Hall, lyui; bociety for 
Participatory Research in Asia [PRIA1, 1985). Second, all people 
are assumed to possess strengths upon which they can build (l-reire, 
1982; PRIA, 1985; Tandon, 1981; Torre, 1986). Evaluation as 
empowerment also assumes that individuals have a need to be 
personally productive, to taKe responsibility and contribute 
something useful to their reality (Whitham, lyy*). Perhaps the Key 
assumption involves the importance of recognizing personal Knowledge 
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and experience as valid and useful in coping effectively with one's 
environment (i-rtire, iy/3; KK1A, iy«b| landon, l yui ; lorre, iya6>. 

Though some authors tee empowerment as a more static state of 
being (Berger & Neuhaus, W//) f most refer to it as a process 
(Baker-Miller, 1982; Cochran, 1986} Kieffer, 1984; PRIA, 1985; 
landon, lyui; Kappoport, iy«l; Kiley, iyu4j Vanderslice, iyu4; 
Whitham, 1982). This process focuses on different levels, from 
individual change (baker-fli I ler , iyu2; Kiefter, iy«4> to a group or 
collective emphasis (Fernandes iTandon, 1981; Freire, 1985; Hall, 
iy«l; Vanderslice, WW\ Whitham, iy«*>, and to a focus on 
organizational or institutional change (Barr, Cochran, Riley & 
Whitham, iy«4j Hall, iy«ij hreire, iy«b; KK1A, lyab). KKiA sees 
awareness (of issues in one's daily life and their connections with 
larger structures* and action (toward changing those relationships; 
as the Key elements in empowerment. 

in many discussions of empowerment, it is envisioned as a 
series of stages (Cochran, 1986), components (Torre, 1986;, aspects 
(Kieffer, iyu4) or interrelated actions (Vandersl ice, iy«4>. Kiley 
(1984) identifies empowerment as an "ecologically complex process" 
involving the "interlinked contribution" of the individual, 
mediating structures (small groups) and larger macro system 
influences. uihitham's work (iy«2) deals specifically with 
empowerment as it relates to young people and is therefore 
particularly relevant to the case study cited in this paper. "Youth 
empowerment is the process by which young people learn, through 
active participation in the relationship*, events and institutions 
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that affect their lives, to develop and apply thtir capacity to 
transform themselves and the world in which they live" *p.l). 

Drawing on these sources, then, empowerment is defined, for 
purposes of this paper, as: 

an interactive process through which people experience 
personal and social change, enabling them to taKe action 
to achieve influence over the organizations and 
institutions which affect their liv?s and the communities 
in wh ich they l i ve . 

Ihe challenge tor evaluators interested in empowerment is to 
determine how to operational ize this definition in the evaluation 
context. A deeper understanding of the concept of empowerment 
offers important information in this regard. 
Phases of the process at empowerment 

Writers investigating the question of empowerment draw upon 
empirical research to examine the process in more detail. Several 
studies outline various phases in the empowerment process. Perhaps 
the most detailed study of stages involved in the empowerment 
process is the Family Matters Project (Cochran, 1986; Cochran & 
Henderson, Wti6) . Here, the empowerment process is conceived as a 
series of five stages, progressing from personal change to social 
action, stage i involves positive changes in individual self- 
perception and Stage II refers to changes in family relationships. 
Stage lii moves the participant into interaction with others beyond 
the family. Stage IV is seen as information gathering about 
relevant community issues, followed by change-oriented community 
action in Stage V (Cochran 6c Henderson, 1986, pp. 106-108). "Thus, 
there tareJ different aspects of the empowerment process, beginning 
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with the way in which individuals view themselves and progressing 
through relations with nearby others to interactions with more 
distant organizations and insti tutions" (Cochran, 1986, p.22>. 

Vandersl ice (iyy<u notes that different wn ters have 
identified various "interrelated actions" contributing to 
empowerment, ihese include the recognition and valuing of one's 
skills, knowledge and resources as well as their expansion, a 
broadening of interpersonal networks, and becoming involved with 
one's environment. 

in addition to feelings of self worth and legitimacy, lorre 
(1986) identifies a citica! understanding of macro structures as 
crucial to empowerment. Such a critical perspective leads to a 
further component of empowerment, reflective action directed towards 
responsible social change. 

Ihe "empowerment cycle* discussed by Whitham (iy«*> involves 
three phases. "Learning" about oneself and one's environment through 
interaction with adults is followed by "realizing power" or applying 
new knowledge and skills and taking responsibility. The third phase 
is "acting," initiating changes in the community. 

All of these conceptualizations of empowerment can be seen as 
congruent with Uochran's model. lhat is, they cluster into actions 
at the levels of the individual (recognition of the value of one's 
own skills, knowledge and resources, as well as learning new ones; 
feelings of self-confidence and legitimacy* ; the interpersonal 
(broadening networks to overcome individual isolation; recognition); 
and the env i ronmental ( in vol vement i n successful inter act i on s with 
one's environment; action oriented towards social change;. 
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In the evaluation context, the stakeholder process can be 
structured to enhance empowerment at each level. individual 
stakeholder's knowledge and skills can be recognized and developed 
through participation in certain technical evaluation tasks, such as 
questionnaire design or data analysis. Interaction of stakeholder 
groups is likely to facilitate networking among them, while pursuing 
specific actions toward program or organizational change can result 
in empowerment at the environmental level. these actions can be 
operational ized in an evaluation by utilizing specific strategies to 
support stakeholder empowerment at each stage, txamples of possible 
strategies are discussed below in relation to the case study. The 
focus on process also suggests a different emphasis and set of tasks 
for the evaluator. 

I mp I icat ions fp£ the Hole of tvaluators 

Viewing evaluation as a process of empowerment has clear 
implications for the role of the ©valuator. While Uronhach uy«U) 
sees the evaluator as public scientist, Eisner (1983) suggests the 
role of connoisseur/cr itic, ureene describes a facilitator 

role and Stake (1984) characterizes the evaluator as educator, the 
role of the evaluation in an empowerment formulation becomes that of 
enabler. The evalua' r as enabler goes beyond the educator or 
facilitator roles which focus exclusivel> on process in that the 
enabling role also includes concrete action to change a given 
situation. Ihe enabling role thus involves praxis, a process of 
reflection and action, combining ecucation of stakeholders as 
individuals and as a group, with action directed towards change in 
the en vi ronmental context . 



Case Study example 
Ihe case study involves a participatory evaluation in which a 
group of six young people conducted a survey of youth employment 
needs in a small upstate New YorK community. As the evaluator/ 
consultant, I trained and supervised the youth throughout the 
process. in order to examine questions of empowerment in a 
stakeholder evaluation, I also studied the "side effects* that their 
participation had on them as individuals and as a group as welt the 
effects of stakeholder participation on the program and 
organization. bide effects were defined as changes or results 
stemming from participation in an evaluation process which have not 
necessarily been intended by evaluators or identified in the 
literature, and which may or may not be related to the main effect 
of empowerment. 

Ihe first step in analyzing the data was to categorize the 
side effects found. These are listed in Table 1. Once a set of 
categories of side effects had been developed, linkages between side 
effects and empowerment were established by comparing specific side 
effects with empowering actions at each level <for details, see 
Whitmore, 1988). 



Tabl e 1 about here 



Empowering effects for individual participants included 
increased feelings of self-efficacy and the learning of new 
knowledge and skills. For the group, there was enhanced group 
cohesion as well as recognition <by both members themselves and 
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outsiders) of their capacity to do competent work. At the 
individual and group levels, then, the data indicated that the youth 
were clearly empowered through the participatory evaluation process, 
rtt the environmental or action level, measured through actual 
changes in the program and organisation, empowerment was less clear, 
though there were empowering effects at these levels, these 
translated only occasionally into participation by the young people 
in decision maKing forums or into specific change-oriented action. 
One example of empowerment at this level was the involvement of one 
group member on a county planning committee developing a three year 
plan for youth in the area. Because of her participation, youth 
employment was given high priority in the committee's final report. 
More emphasis with the young people on the importance of follow up 
activities would nave strengthened empowerment at this level. 

My role as trai ier/consul tant for the youth group was that of 
enabler. Such a role involved assisting participants to develop 
individual and interpersonal competencies and take effective action 
towards change at the programmatic and organizational levels. in 
this case study, the primary vehicle utilized was a set of 
strategies designed to facilitate the young people's taking maximum 
control of decisions involved in conducting the evaluation project, 
it is important to note that the particular agency involved 
supported these goal s, of f er i ng an unusual 1 y recep 1 1 ve env i ronment 
for such a project. ihe strategies included u) a staf f/eva I uator 
team, (b) having a concrete and responsible task to do which was of 
importance to the organization, u) a written contract (including 
payment) | <d) a structured sequence of evaluation tasks, (e) 
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attention to group process, and <f> publicity. The staf f/eval uator 
team consisted of regular debriefing and planning sessions with the 
agency staff member most closely involved with the young people. 
Her extensive understanding of the young people as individuals and 
as a group complemented my knowledge of evaluation methodology 
maximizing the effectiveness of our worK with them. Having an 
"Tipui f*nt task to do and a contract increased the group's sense of 
responsibility and its accountability for producing a specific 
product. By carefully structuring the specific evaluation tasks 
which needed to be done, i could assist the participants to make 
design and analysis decisions. Specifically, for example, in 
designing the questionnaire, they needed to understand how to frame 
questions, learn the difference between open ended and closed 
questions and the advantages and limitations of each. Ihe process 
of doing this was primarily experiential, trying out questions in 
role plays and then analyzing the responses. Here, the youth were 
particularly good at playing the monosyllabic teenaged respondant 
which helped them not only to frame well phrased questions but also 
gave them interviewing practice. Data analysis consisted of 
figuring out what the numbers meant and sorting open ended responses 
into categories. Attention to group process meant that group 
building exercises and reflection on tneir collective interaction 
were included as part of each meeting. Publicity involved a feature 
article in the local newspaper highlighting their findings, as well 
as wide distribution of the report to relevant agencies and 
community groups. 
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Table 2 illustrates the linkages between these strategies and 
empowerment. Here aach strategy is linked to certain empowering 
side effects at each level. These are then associated with a stage 
in the empowerment process. Ihus, individual and group side effects 
contribute to those stages in the empowerment process, while 
programmatic and organizational side effects reflect the 
environmental phase of empowerment. 

Table 2 about here 



These strategies are transferable to other contexts, with 
details varying to fit the particular task and participants. 
Uhatever the specific strategies are used, however, the evaluator as 
enabler must develop them from the framework of basic assumptions 
and goals of evaluation as empowerment. 

Linkages between empowerment and utilization 
There are several ways that the empowerment process can be 
related to evaluation use. Utilization in the evaluation literature 
has been defined in three ways, conceptual use, persuasive or 
symbolic use anJ instrumental use (Leviton & Hughes, lyan. 
Conceptual use refers more to the process of utilization, wnile 
instrumental use is more outcome oriented. Persuasive or symbolic 
use can relate to both process and outcome in that it involves 
processes of interpersonal influence as well as the use of more 
concrete evaluation evidence to build support for specific actions. 
Ihe phases of the empowerment process parallel this 
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conceptualization, with the individual and interpersonal or group 
stages of empowerment contributing to conceptual and symbolic 
utilization, while the action stage parallels instrumental and also 
symbolic use. H stakeho.Jer participation is assumed to enhance 
evaluation utilization, empowerment could be hypotnesized as a 
mediating variable, as illustrated in Mgure 1. 



h igure 1 here 



Specifically, tor ex amp le , indi vidua I empowerment processes 
such as learning new knowledge contributes directly to conceptual 
use. Persuasive or symbolic use involves interpersonal processes, 
"getting others to go along with the implications of evaluation* 
(Leviton & Hughes, ly&l, p.b^yj. toth increased cohesi veness, 
recognition or pu icity contribute tc interpersonal or group 
empowerment and to persuasive use. instrumental use reflects 
specific programmatic or organizational change and is related to the 
environmental action phase of the empowering process. 

Another way to conceptualize empowerment as a mediating 
variable between participation and utilization is shown in Mgure t* 
Empowerment increases accountability for evaluation use in that 
participants who exercise control over an evaluation process also 
assume responsibility for following up and taking concrete action. 
Ihe use of strategies such as having a concrete task to do and a 
written contract are particularly related to accountability. Having 
responsibility tor decision making increases participants' sense of 
ownership of th evaluation and what occurs as a result (Greene, 



1987; Leviton 4 Hughes? 1981). As in Figure 1, instrumental use 
parallels (he environmental or acf.on phase of empowerment. 



h igure l about here 



Conclusion 

Participation ir and of itself does not necessarily increase 
evaluation use. Indeed, token participation is MKely to result in 
stakeholder indifference or cooptation (Weiss, 1983;. Only if 
participation involves stakeholders in empowering ways will 
evaluation use be more evident. Empowerment and evaluation 
utilization are thus part of the same process. increasing 
evaluation use in all its manifestations will occur only when 
stakeholders fully understand an evaluation process, are willing to 
support it openly, and feel enough sense of involvement and hence 
accountability to pressure for implementation of specific 
programmatic or organizational change. 
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